feat(ai-red-teaming): agentic-suite tool (run all attacks on an agent) + scenario docs - #112
Open
rdheekonda wants to merge 2 commits into
Open
feat(ai-red-teaming): agentic-suite tool (run all attacks on an agent) + scenario docs#112rdheekonda wants to merge 2 commits into
rdheekonda wants to merge 2 commits into
Conversation
generate_atlas_attack's scenario_name now lists devops (RCE) and support (exfil) and notes the environment-derived names (devops-rce, support-exfil) resolve to the shipped argument-aware policy. environments doc lists the new devops-rce-mesh / support-exfil-mesh targets.
… on an agent Adds a turnkey capability tool + workflow generator that runs the FULL agentic suite (every OWASP-ASI category, auto-selecting the mapped attacks, family transforms, and detection scorers via the SDK's run_agentic_suite) against an agent HTTP endpoint — the "run all possible attacks / red team my agent" path, no need to name individual attacks. Wires it into the agent decision tree + tool list so the TUI agent picks it for broad/complete agent audits. Generate-verified + capability test; live TUI run pending SDK release.
rdheekonda
marked this pull request as ready for review
August 6, 2026 19:13
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Makes the AI-red-teaming capability able to run all possible attacks against an agent in one shot — the "red team my agent, here are the details" path in the TUI — plus the devops/support scenario docs.
Companion PRs: dreadnode-tiger SDK (
run_agentic_suiterunner + arg-aware gate) #2181, security-tasks environments #146.What's included
generate_agentic_suite_attacktool (tools/attacks.py) — point it at an agent HTTP endpoint (preset or custom request/response template) with anattacker_model; omitcategoriesto run every OWASP-ASI category. Auto-selects the mapped attacks, family transforms (MCP, multi-agent, reasoning, exfiltration, …), and detection scorers via the SDK'srun_agentic_suite. No need to name individual attacks.scripts/attack_runner.py) — emits a workflow that builds the agent target and callsrun_agentic_suite; registered in the runner method table.agents/ai-red-teaming-agent.md) — added to the decision tree ("run all possible attacks / red team my agent →generate_agentic_suite_attack") and the tool reference, so the TUI agent picks it for broad/complete audits.generate_atlas_attack'sscenario_namenow listsdevops/support+ env-derived names;environments.pylists the newdevops-rce-mesh/support-exfil-meshtargets.Validation
TestScriptGeneration::test_agentic_suitepasses: the generator produces a syntactically valid workflow that callsrun_agentic_suite(and defines the agenttarget(.ruff --select E9,F63,F7,F82) clean on the changed files.Honest status / follow-up
generate_atlas_attack. A live TUI end-to-end run of the full suite lands once the companion SDK (run_agentic_suite) is released and the capability runtime picks it up — I did not fake an end-to-end claim here.Test plan
generate_agentic_suite_attackagainst a mesh